Edit Models filters

Inference Providers

Nebius AI Studio

HF Inference API

Misc

4-bit precision

8-bit precision

Inference Endpoints

text-generation-inference

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

2,283

Full-text search

Active filters: quantized

meimeilook/BAGEL-7B-MoT-FP8

Any-to-Any • Updated 4 days ago • 12

RedHatAI/Llama-4-Scout-17B-16E-Instruct-FP8-dynamic

Image-Text-to-Text • Updated 4 days ago • 9.3k • 20

jedisct1/MiMo-7B-RL-GGUF

Updated Apr 30 • 14.2k • 21

Gapeleon/bytedance_BAGEL-7B-MoT-INT8

Any-to-Any • Updated 8 days ago • 365 • 22

RedHatAI/DeepSeek-R1-0528-quantized.w4a16

Text Generation • Updated about 20 hours ago • 126 • 3

Tonic/GemmaX2-28-2B-4bit

Translation • Updated Feb 26 • 55 • 3

nvidia/Llama-4-Maverick-17B-128E-Instruct-FP8

Updated 5 days ago • 225 • 2

RedHatAI/Mistral-Small-3.1-24B-Instruct-2503-quantized.w4a16

Image-Text-to-Text • Updated 4 days ago • 1.21k • 4

RedHatAI/Qwen3-30B-A3B-quantized.w4a16

Text Generation • Updated 21 days ago • 653 • 3

MaziyarPanahi/DeepSeek-R1-0528-Qwen3-8B-GGUF

Text Generation • Updated 5 days ago • 21.4k • 2

MaziyarPanahi/SciPhi-Self-RAG-Mistral-7B-32k-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26, 2024 • 66 • 3

qualcomm/ControlNet

Unconditional Image Generation • Updated Apr 9 • 123 • 9

MaziyarPanahi/Mistral-7B-Instruct-v0.3-GGUF

Text Generation • Updated May 22, 2024 • 282k • 99

legraphista/Nxcode-CQ-7B-orpo-IMat-GGUF

Text Generation • Updated Jun 2, 2024 • 477 • 1

qualcomm/Posenet-Mobilenet-Quantized

Keypoint Detection • Updated Apr 9 • 135 • 5

legraphista/shieldgemma-9b-IMat-GGUF

Text Generation • Updated Aug 5, 2024 • 251 • 1

RedHatAI/Llama-3.3-70B-Instruct-FP8-dynamic

Text Generation • Updated 4 days ago • 6.69k • 6

MaziyarPanahi/Slush-ChatWaifu-Chronos-GGUF

Text Generation • Updated Feb 10 • 38 • 1

MaziyarPanahi/gemma-3-12b-it-GGUF

Text Generation • Updated Mar 12 • 235k • 10

MaziyarPanahi/gemma-3-27b-it-GGUF

Text Generation • Updated Mar 16 • 219k • 5

MaziyarPanahi/ReasonFlux-F1-14B-GGUF

Text Generation • Updated Mar 24 • 28 • 1

boltuix/NeuroBERT-Tiny

Text Classification • Updated 11 days ago • 221 • 10

ABDALLALSWAITI/FLUX.1-dev-ControlNet-Union-Pro-2.0-fp8

Text-to-Image • Updated Apr 19 • 5.13k • 27

patf82/Absolute_Zero_Reasoner-Coder-14b-5.0bpw-exl3

Updated 20 days ago • 8 • 4

boltuix/NeuroBERT-Small

Text Classification • Updated 12 days ago • 202 • 9

boltuix/NeuroBERT-Pro

Text Classification • Updated 12 days ago • 202 • 9

HagalazAI/CyberDolphin-2.9.3-mistral-nemo-12b-GGUF

Text Generation • Updated 11 days ago • 650 • 2

Jimmi42/sarvam-m-4bit-mlx

Text Generation • Updated 8 days ago • 8 • 1

roylin1003/royal-zhTW-ID-f16.gguf

Text Generation • Updated about 5 hours ago • 1

Lewdiculous/InfinityRP-v1-7B-GGUF-IQ-Imatrix

Updated May 4, 2024 • 461 • 45